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Abstract 

In this paper, we have developed a parallel branch and bound algorithm which computes the 
maximal structured singular value fi without tightly bounding /j, for each frequency and thus 
significantly reduce the computational complexity. 
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1 Introduction 

It is well known that the analysis of robust stability and performance with structured uncertainty 
boils down to the problem of computing the supremum of the structured singular value over all 
frequency [3l[TT]. That is, fimax '■= sup^^gj^ ^Al-^Of^)) where M{s) is the transfer function of the 
generalized system and A is a set of block structured uncertainties. Related to this problem are 
the method proposed by Lawrence, Tits and Dooren [3 [H] and the approach established by Ferreres 
and Biannic [5l[6]. These interesting techniques can be applied to compute a fj, upper bound over 
a frequency interval without gridding of frequency. For the precise computation of the maximal 
structured singular value Umax (i-e., a tight lower bound is also expected in addition to an upper 
bound), the conventional method is to grid a range of frequency and compute the maximal /x among 
all the frequencies [T]. Since the exact computation is in general impossible, is obtained for each 
frequency by tightly bounding. Sophisticated upper bounds and lower bounds have been derived for 
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example in [21 [3l HI [10] and techniques such as branch and bound [9] have been developed to refine 
the bounds. 

It is noted that the existing techniques for computing the maximal structured singular value Umax 
lack of efficiency because of the tedious frequency sweeping. In this paper, we investigate a smart 
frequency sweeping strategy. More specifically, we apply branch and bound scheme to compute /i for 

> 1 frequencies in parallel. We introduce a powerful "pruning " mechanism. That is, eliminate 
any branch with upper bound smaller than where ft is the maximum record of the lower bounds 
of all branches ever generated and e > is the tolerance. The final fl is returned as the maximal 
structured singular value ^max- Since jl is the maximum record of the lower bounds obtained in all 
branches generated (no matter belong to the same frequency or not), it will increase much faster 
than its counterpart in the conventional frequency sweeping algorithms. Note that the raise of jl 
results in a significant number of branches to be pruned. Thus jl convergences quickly to the maximal 
structured singular value ^max • 

The paper is organized as follows. Section 2 discusses existing techniques for computing the 
maximal structured singular value. Section 3 presents our Parallel Branch and Bound Algorithm. 
An illustrative example is provided in Section 4 and Section 5 is the conclusion. 



2 Conventional Frequency Sweeping 

Consider an M — A set up as follows. 



M 

Figure 1: Uncertain System. 
Let A be a set of block structured uncertainties. We consider the computation of 

^■max ■■= sup /XA(M(ju;)). 

For notation simplicity, let M(u;) = M{jijj). Then ^max = sup^gj^ /iA(-^^('^))• 
In practice, it is impossible to search ^max over all frequencies. However, we can estimate /i, 
as follows. 

Choose a range of frequency [a, 6] G R and grid it as 

(6-a)(j-l) 



^^■ = '^+ NK-l 



,NK 



(1) 
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where N >2 and K > 1 are integers (In practice, gridding is usually based on the logarithmic scale. 
However, in this paper, we use uniform gridding for the simplicity of description.) Then an estimate 
for Umax can be defined as 

jlmax ■■= max ^/i^{M{LJj)). 
j=l, -- ,NK 

Define the (maximum positive real eigenvalue) function : C"^" ^ R as 
A/j(M) := max{A : A is a positive real eigenvalue of M} 
with Aij(M) = if M has no positive real eigenvalues. Let BA := {A € A : a'(A) < 1}. Then 

uaIM) = max Ar(MA). 

AeBA 

Let Q C BA. Define // on a box |9j 

fj.{M,Q) := maxAif(MA). 

There exists techniques in [9] for computing an upper bound UB{M, Q) and a lower bound LB{M, Q) 
for /i(M, Q). Thus a branch and bound scheme can be applied to compute ii/^{M) with parameter 
space BA. 

The conventional methods work essentially as follows. For j = 1, • • • ,NK, apply the following 
Algorithm 1 to compute an upper bound UB^ and a lower bound LB-' for fi/^{M{ujj)) such that 
U B^ — LB-^ < £. Then jlmax satisfies 



where 



max LB^ < Umar < max UB^ 



max UB-^ — max LB^ < e. 

j=l,---,NK j=l,---,NK 



Algorithm 1 — Branch and Bound ([9J) 

Initialize Let Uj = {Qk} = BA. 

Let 



UB^ = maxUB{M{ujj),Qk), 

k 

LB^ = max LB {M{coj),Qk). (2) 

k 



while UB^ - LB^ > e 

• Choose Q to be any element of Uj with UB{M{ujj), Q) = UBK 

• Partition Q into Qa and by bisecting along one of its longest edges. 

• Add Qa and Qh into Uj . Remove Q from Uj . 



3 



Remove from lAj any Q with 

UB{M{uj),Q) < LBK 



(3) 



endwhile 

The most important mechanism of Algorithm 1 is "pruning" [U]. That is, any element oilAj for 
which ([3|) is satisfied will never again be partitioned and need not be considered further. We call 
inequality ([3]) as the "pruning condition" . 

We can see that existing techniques for computing fimax employ branch and bound techniques for 
each frequency independently. In particular, the pruning process for one frequency is independent 
of another. ^/^{M) is bounded tightly for each frequency. Note that we usually need to evaluate 
MA {M) for many frequencies in order to obtain a reasonably good estimate of the maximal structured 
singular value fJ^max- Thus the overall computation is still a heavy burden, even the computation of 
H^{M) for each frequency is very efficient. 

Thus for the sake of efficiency, there is a strong motivation to conceive a smart frequency sweeping 
strategy. More specifically, we would raise the following question. 

Is it possible to obtain the maximal structured singular value fimax without tightly bounding 
IJL/:^{M{ijjj)) for each frequency loj ? 

The following section is devoted to answering this question. 

3 Parallel Branch and Bound Algorithm 

It is fair to compare the performance of different algorithms on the same set of frequencies. Therefore, 
we consider again frequencies ujj, j = 1, • • • , NK defined by ([1]) and relabel them as 

, (b-a)[K{i-l) + {j-l)] M ■ ^ K 

Now we are in a good position to present our Parallel Branch and Bound Algorithm as follows. 
Algorithm 2 — Parallel Branch and Bound Algorithm 

• Step 1: Initialize. Set j = 1. Set fi = 0. Set tolerance e > 0. Set maximal iteration number 
IT. 

• Step 2: Update fi and record the number of iterations r{j) for frequency LOij by the following 
steps. 

- Step 2-1: Let Uij = {Qk} = BA, i = !,■■■ ,N. Set r = 1. 

— Step 2-2: If r = IT + 1 or Uij is empty for any i G {1, • • • , N} then record r{j) = r and 
go to Step 3, else do the following for all i such that Uij is not empty. 
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* Choose Q to be any element of Uij with 

UB{M{uj^j),Q) = max UB{M{ajij),Qk). 

* Partition Q into Qa and Qi, by bisecting along one of its longest edges. 

* Add Qa and into Uij. Remove Q from lAij. 

* Update 

fi = max{/i, LB{M{uj^j), Qa), LB{M{uJij), Qb)}. (4) 

* Remove from Uij any Q with 

i7S(M(a;i,),Q) < (5) 
— Step 2-3: Set r = r + 1 and go to Step 2-2. 
• Step 3: If j = K then STOP, else set J = J + 1 and go to Step 2. 

In Algorithm 2, branches of frequency sweeping are performed in parallel with starting fre- 
quencies uJii, i = 1, • • • ,N and step size ^^z^- Also, a branch and bound scheme is applied to 
compute /i for N frequencies in parallel. Any branch with upper bound smaller than will be 
pruned, where ft is the maximum record of the lower bounds of all branches ever generated. The 
final p, is returned as the maximal structured singular value Umax- Algorithm 2 is visulized in the 
following Figure [2j 

Remark 1 Note that Algorithm 2 provides a substantial improvement on efficiency than conven- 
tional methods in computing the maximal structured singular value. This can be explained by the 
significant relaxation in the "pruning condition" of Algorithm 2. To see the difference of the two 
"pruning conditions", we can compare the right hand sides of inequalities and By ^ and 

we can see that can be much larger than LBK This is because jl is the maximum record 
of the lower bounds obtained in all branches of all frequencies evaluated and being evaluated, while 
LB^ is only the maximum record of the lower bounds obtained in branches of the frequency being 
evaluated. Moreover, fi is enlarged to in the "pruning condition" and hence the "pruning" 
process is further facilitated. The significant relaxation of the 'pruning condition" leads to a substan- 
tial decrease of the number of total subdomains needed to be evaluated. Therefore, our algorithm is 
much more efficient than those previously available to control engineers. 

Remark 2 It is important to note that Algorithm 2 involves only one CPU processor. It is funda- 
mentally different from the parallel algorithms which involves more than one CPU processors. 
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Figure 2: A Picture of Parallel Branch and Bound Algorithm. = 3, K = 4. 

Remark 3 A substantial amount of computation can be saved by the following mechanisms. First, 
further computation of the lower bound on a domain is not needed once it is determined that the 
lower bound is smaller than the existing global lower bound. This can be seen from equation 
Second, the computation of the upper bound should be terminated once condition ([^ is satisfied. The 
idea of these two mechanisms is to avoid as much as possible the tightly computation of the lower 
bound and the upper bound. 

In addition to the novel frequency sweeping strategy, another character of Algorithm 2 is that 
there is no tolerance criteria directly forced on the final result, however, the final result falls into 
tolerance automatically. 



Theorem 1 Suppose that the maximal iteration number IT < oo and that Algorithm 2 stops with 
r{j) < IT, j = 1, - ■ ■ ,K. Then the final jl satisfies 



< 



< e. 



Proof. Since fi is the maximal record of the lower bounds, we have /imax — A — 0- We only need to 
show that < g. By the assumption that Algorithm 2 stops with r(j) < IT, j = 1, • • • ,K, we 

know that all subdomains ever generated are finally removed because the "pruning condition" ([5]) is 
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satisfied. Note that there exists a subdomains Qij for frequency Wij such that ^{Miujij), Qij) = jlmax- 
Let fi = fL when Qij is removed. Then flmax ^ UB{M{uJij), Qij) < j^. Note that ft is nondecreasing 
thus the final fi > fi. It follows that 

The proof is thus completed. 

□ 

Note that one important concern of an algorithm is convergence. It is usually desirable that, 
given any tolerance e > 0, an algorithm stops and returns the result within tolerance in a finite 
number of iterations. Obviously, the convergence requirement imposes condition of the quality of 
bounds. 

Definition 1 The upper bound UB(M, .) and lower bound LB{M, .) are said to be continuous if 

lim UB{M, Q) - LB{M, Q) = 

d{Q)^0 

where d{Q) := max^ \ \q — q\\ with Q C BA. 

Theorem 2 Suppose that all the upper bounds and lower bounds are continuous and that at least one 
nonzero lower bound appears after a finite number of iterations. Let the maximal iteration number 
IT = oo. Then, for arbitrary tolerance e > 0, Algorithm 2 stops with a finite number of domain 
partitions for each j, i.e., r{j) < oo, j = 1, - ■ ■ , K. Moreover, the final /z satisfies 

Q ^ fJ-max ~ ^ ^ 

Proof. Suppose that Algorithm 2 does not stop with a finite number of domain partitions for each 
j. Then 3 Uij and an infinite sequence of nested subdomains {QV} associated with frequency ujij 
such that Qi D Q2 D ■ ■ ■ D Q^r D ■ ■ ■ . Note that by the assumption 3ro < 00,/io > such that 
A ^ A^O; Vr > tq. By the continuity, 3ri such that 



UB{M{uj^,),Ql^) - LB{M{uj^,),Qi^) < ^/xq, Vr > n. 



Let r2 = max{ro, ri} + 1. Then 



UB{M{u:,j),Q%) - LB{M{u:,,),Qi{) < ^^o- 

Thus 

UB{M{uj,,),Qi{_,,)-fi<-^^fi =^ UB{M{u,,),Q%^,)<-J^ 
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which imphes that (5^2+1 removed. This is a contradiction. Therefore Algorithm 2 stops with a 
finite number of domain partitions for each j and hence by the same argument of Theorem [1] 



The proof is thus completed. □ 



4 An Illustrative Example 



Consider an M — A set up as shown in Figure [U where A = diag((5i, G R^""^ and M(s) 
C(sl - with 
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To compute the supremum of /x, we uniformly grid frequency interval [0.01, 15.01] and obtain 1, 500 
grid frequencies as 

0.01) (i 



0.01 + 



15.01 



1 



J 



1500 - 1 

In Algorithm 2, we choose the relative error e = 0.01 and 
are regrouped as 

^15.01 - 0.01)[50(i - 1) + (i - 1)] 



0.01 + 



1500 - 1 



I,--- ,1500. 

30, K = 50. The 1,500 frequencies 

:1,--- ,30; j = l,-- - ,50. 



The execution of Algorithm 2 is terminated at r = 1 with fi = 0.8424 achieved at frequency coij = 
9.1661 where i = 19, j = 16. It is observed that, for any frequency, no partition is performed for 
the original domain BA = [—1,1] x [—1,1]. This is because is greater than the upper bounds 
of singular values for BA at other frequencies. The bounds of singular values for BA are shown by 
Figures 3-4. It can be seen from these figures that the upper bounds and lower bounds of singular 
values are far apart for most of the frequencies. To compute the maximal singular value using the 
conventional branch and bound method, substantial computational effort will be wasted on reducing 
the gap between the upper bounds and lower bounds of singular values for most of the frequencies. 
This example demonstrates that branch and bound should not be applied extensively for any fixed 
frequency. Quiet contrary, it should be employed in parallel and in a cooperative manner. This spirit 
has been reflected in Algorithm 2. 
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Figure 3: Bounds of Singular Values 

5 Conclusion 

Efficient computation of the maximal structured singular value is of fundamental importance in 
robustness analysis and robust synthesis with structured uncertainty. Motivated by this, we have 
developed a parallel branch and bound algorithm for computing the maximal structured singular 
value, which significantly reduce the computational complexity. 
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